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• THE. 0:?aL EX/U-IIMATION 
IN EDUCATIONA.L EVALUATION 



The oral examination, an important and potentially useful evaluation instrument ,, 
is, at present, used primarily in graduate instruction . Although oral test's 
ar£ sometimes maligned bjr educators , research evidence indicates ' that they are 
probably as valid and reliable as other testing techniques . The authors present 
several innovative formats and urge their implementation at a variety of ed- 
ucational levels. Discussed are the use of student panels , group oral testing , 
aiid the use of multi-mediated case analysis techniques . 

Despite their apparent respectability and widespread usage, oral examinations 
have been the subject of only sporadic and sometimes superficial investigation. 
Their evaluation, for the most part, has been undertaken by educational tech- 
nologists rather than by speech teachers and scholars. However, oral examin- ' 
ations can provide important and useful information about a student's level of 
kpswledge difficult to obtain through other testing modes. Ideally then, speech 
communication educators should become actively involved in the problems of dev- 
eloping systematic, comprehensive, and creative approaches to applying. the oral 
mode to the testing process. The purpose of this paper is to evaluate the oral 
examination process and to suggest improvements and innovations potentially use- 
ful in speech coraiiunication instruction. 

-ATTITUDES Ta-;ARD OBAL TESTING 
The literature on evaluating educational outcomes by oral er.iminations con- 
tains a substantial number of negative opinions. In 1929, 'tuch offered several 
fundamental criticisms of oral testing based upon the writings of Horace I'knn.l 
Beyond his opinion that oral examinations were not "economical of time" he 
contended that they "tend to be unsystematic, and to be deflected from the aim of 



the examiner by unforsecn circumstances.'* Moreover, he contended that the oral 
format produced a "greater tendency to emotional disturbances as compared witr. 
written tests. ''^ About the same date, Pressey, Pressey, and Barnes declared 
that "oral examinations are distinctly unreliable-- so unreliable that use of such 
a method in deciding the educational fate of a student would seem a matter for 
thoughtful consideration. "3 

More recently, Smith and Adams assert that oral examinations do not measure 
Khat they are supposed to measure: 

A student might know the subject matter to perfection but 
become excited over the type of test and fail completely. 
Regardless of the objectives of teaching, such a test is 
essentially a measure of poise, vmich probably was not one of 
the objectives at all.^ 
Keiss indicts oral ez^aminations because students- have "...few formal oppor-. 
tunities to express themselves orally and are more uncomfortable vjUen required to 
do so." She ^contends that, "For those who have little talent for verbalising, 
the experience is often stressful."^ In a very harsh indictment, Johnson char- 
acterizes the oral examination for the master's degree as either a final hurdle 
or merely protocol. ^ Halio also ..launches a strong attack on oral testing, "vJhat 
happens then is:that it quietly degenerates into a mere test of the student Is 
capacity to memorize details and his mental agility or deftness'' in parrying 
questions...."'^ Finally, in an article published in the American Journal of 
Physics, Piatt raises wiiat might seem to be every possible objection to the oral 
modie of examination, contending that it: 

...is nece::sarily variable from student to student ... .is wii- 
fair and uneven. .. .introduces uncontrollable biases in 
judgment.. . .is the hardest kind of exam for a committee to 
learn to give-. . . JandJ is ^unreliable as compared to a vxritten exam. 



These judgments ar^based almost entirely on observation and personal opinion 



vrith little or no evidence offered for support 

Wot all comments about oral examinations are negative. Morrissett, in his 
survey of student attitudes, found that oral examiaations are considered more 
pleasant and less difficult than written tests. These same students reported that 
they learned more but had to study harder for oral exams. In addition, they felt - 
that orals covered more material and provided a better opportunity to demonstrate 
their knovrledge.^ VJrightstone, Justman, and Robbins contend that oral examin- 
ations permit the examiner to follovr the thought process used by a student in 
answering a question.-'-^ Ness, in his Guide to Graduate Study , concludes that the 
oral examination encourages the student to reviev/ and organize his knowledge."'""'' 

According to Kostick and Nixon, the oral mode facilitates using follov;-up quest- 
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ions to proviae a better estimate of the student's state of knowledge. It 
penaits students who misunderstand or evade a question to be "re-routed" to 
address the question directly. According to Halio, it also enables the examiner 
to estijnate the student's ability to think on his feet."'"^ The Chicago Board of 
Education gives credence to this testing mode by requiring an oral examimtion of 
teachers and administrators both for initial employment and for promotion."'"^ 

S'4PIRlGiiL STUDIES 

Although opinions regarding oral testing abound, a dearth of empirical evi- 
dence plagues teachers who wish to acquire factual evidence. Early empirical 
studies on this subject generally "fall into one of two categories. Research 
carried out at about the same time that objective testing was being developed, 
mostly concentrates on the administration of written examinations in the oral 
mode."''^ The findings of these studies support the . conclusion that the two modes 
are generally comparable and that "...neither mode of presentation will enable 
every student to make his best possible shovring. . . . "•'•^ 

The second class of early research studies contains those dealing primarily 



with oral testing in firaduate ins t motion. "^''^ On the basis of liinited data, 

Trimble suggests that oral examinations are as reliable as written ones."^^ Both 

19 ^rt'oit'^^ pn 

Trimble and Pressey,^and Barnes/^ although basically critics of oral testing, 

conclude that the oral examination has a ri^^^htful place in graduate education. 

More recently, the issue of -.validity and reliability of oral examinations \vas 
'directly addressed. McGuire .concluded that because of the poor structure, con- 
tent, and administration of oral examinations, it was doubtful that they achieved* 
all that their supporters claimed for them.^l Later, McGuire and Babbott, 
studying the ability of students to solve orally presented simulation problems 
reported that this technique exhibits! acceptable validity and reliability.^^ 

Levine and McGuire concluded that by "structuring the examinations, stand-- 
ardizing the case materials, training the ej^miners, and pooling their ratings" 
acceptable validity and reliability levels can be attained thus increasing, 
substantially, the arsenal of techniques available for assessing competencies.^"^ 
Carter lends his support by saying: 

The evidence indicates that oral examinations, when con- 
ducted carefully and systematically, can be highly reliable. In 
fact, they can apparently be as reliable as our better written 
tests. •.. The data suggest that in view of the low correlation 
with the written e>:anination, the oral examination may have 
a unique function. That is, it may result in successful 
assessment of aspects of competence not adequately covered in 
- the written examination. 

IMPLH^EOTATIOM ST.:?;lTEGIES- 
Traditional applications -of oral testing have largely been confined to grad- 
uate instruction. Such applications, for the most pnrt, have not been innovative. 
In fact, in some instances, they have been retrogressive (e.g., treated more as a 
hurdle than as a valid tool for educational measurement).^^ Hov/ever, we can infer 
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from the wide-spread use and common requirement of the oral examination tliat it 
is viex^ed as' a primary instrument for evaluating graduate students. Iz seems 
strategically unreasonable to limit the use of oral examinations to graduate level 
instruction. If we assume that some students function better in the oral mode, 
as some research vjould suggest, a comprehensive evaluation program must include 
a combination of communication modalities in order to produce the most precise 
estimate of the student's current state of knowledge. Although the testing for- 
mat of graduate oral examinations may not be T,;ell suited to lower levels of in- 
struction, creative applications of oral testing are certainly far from being 
exhausted. as^, 

O-.'e of the most exciting innovations in oral testing places students in the 
role ol' examiners by using student panels to evaluate the achievement of their 
peers. _ In 196^, Hartnett developed a technique for utilized student examining 
boards to evaluate the kno;-rledge of their peers. Through seating arrangements, 
he created ten examining centers each consisting of five examiners and one ejsiminee 
allowing ten students to be examined simultaneously. Students \rere instructed to 
prepare questions in advance of the test period and were then randofnly assigned 
to serve as either examiners or respondents. Each examiner, in turn, asked one 
question and then ujnmediately scored the response. Each round was pemitted to 
continue for twenty minutes. Hartnett reports that a minimum of nine or ten 
questions were answered in the allotted time period. At the end of each round, 
students changed to new randomly assigned groups and roles. This procedure per- 
mitted sixty students to be e:cimined during a two-hour period. 27 

Tucker, expanding upon Hartnett 's paradigm, used panels of six students per- 
mitting extensive discussion and interaction betvreen examiners and the examinee. 
He reported that the method V7as very successful and commented favorably on the , 
apparent honesty and objectivity of the student rafccrj„28 ^.aiden adds further 
support for the innovative use of student evaluatorr. She contends that the 



technique not only leads to "intensive study and pursuit of knov;ledf;e, " but also 
aids in the development of "an ethical attitude on the part of the students as 
they endeavor objectively and impartially to score their contemporaries,"'^^ 

A second innovative approach holding ■ considerable potential for enhancing the 
evaluation of educational outcomes is the group oraL performance test. First 
used for officer selection by the British Army during VJorld '^r II/ the technique 
also has been used by the British Civi3. Service^° and the New York City Depart- 

„ment of Health. 31 The procedure combines group discussion techniques \ath oral 
problem solving. For example, several candidates for a position are given a 
problem, allowed to prepare on the topic for several days and then reassembled 

^for a discussion- interaction session, i^aters evaluate the candidate's ability to 
gather data, bring logic to bear on a specific problem, function harmoniously with 
other group members, and assume leadership. ^ters observe and evaluate both 
knovrledge and skills along with personality traits such as flexibility, adapt- 
ability, and assertiveness. Mandell lists the following chief advantages derived ■ 
from the group oral testing format: 

(a) A better all-round knovxledge of the behavior of the candidate 
is obtained. 

(b) The candidate's reaction will probably be more favorable "than 
his reaction to the individual interviev:. 

(c) No skill in questioning on the part of the raters is required. 

Brody and Powell support these advantages of group testing with their ovm in- 

33 

dependent research, 

A further innovative use of the oral examination is the case analysis tech- 
nique used by- Peterson. vShe reports that nursing students were rrbo-t-n short films 
and. asked to comment on properly and improperly performed nursing skills. In 
another application, portions of simulated nurse-patient discussions were viewed 
and students were asked to role-play the conclusion of the discussion. Peterson 
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reports generally positi\e feedback from students who had" experienced this tech- 
nique despite problems caused by inadequate development of c^adio-visual materials. 
Vfliile Peterson's application v/as to nursing education, the tecliniqne seems well 
suited to evaluate students' competencies in such areas as public speaking, conflict 
resolution, interpersonal communication, and salesmanship. 

CONCLUSIONS 

The preceding examin .iion of the oral examination as an educational strategy 
leads to the folloviing conclusions: (l) Critical comments about oral testing 
are not, for the most part, based upon empirical research but are the assertions 
of educational practitioners, (2) Research on oral testing has been neither 
systematic nor oxtensive^- 'lt does^ hov:ever, tend to indicate that the weaknesses 
attributed to oral tasting are not inherent in the process, (3) The value of oral 
examinations can be considerably enhanced by careful attention to the general 
principles of testing coupled with more innovative applications, and {h) Several 
^creative oral testing strategies have been devised and successfully implemented. 
Student panels, group testing, and media-assisted oral examinations are examples 
of such creative uses.. 

As the demand for accountability increases, the evaluation of students must 
receive increased attention. Instructors must implement those tecliniques which 
will provide the laost comprehensive evaluation of educational '"outcomes. Oral 
examinations merit further consideration,- especially in speech communication 
where the oral mode is a vital element. 
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